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Abstract— A specific decision support system (SDSS) that can be used 
as a methodology for choosing an optimal portfolio mix of informa- 
tion systems projects is developed. An SDSS is developed by applying a 
number of well-known techniques in management science. A net present 
value (NPV) of the projects is maximized within limited resources and 
the solution of the model provides the optimal project start period, 
system development language, and staff size. The SDSS conducts a risk 
analysis on those variables that are deemed critical when determining 
the optimal solution. The final phase of the SDSS establishes the value 
of perfect information on these critical variables. To demonstrate the 
usefulness of the model, an example consisting of five information sys- 
tem (IS) projects are presented. It is shown that given the estimates 
of the exogenous parameters of the IS project environment, the model 
can determine when to begin the project development, which systems 
development language to use, and the number of systems development 
staff to assign to each project. Furthermore, the degree of the variability 
of the estimates of exogenous parameters is evaluated through empirical 
probability distributions. 

Keywords — Specific decision support system (SDSS); information 
systems; optimal project mix; risk management; decision analysis; prior 
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Introduction 

IT HAS become devastatingly obvious to many firms that 
they can no longer conduct "business as usual" in order 
to remain competitive in the market. For this reason, cor- 
porations are becoming more acutely aware of the need for 
timely information. Information systems (IS's) which supply 
this information represent the single most important compet- 
itive edge the corporation has for its survival. Firms cannot 
afford to abdicate control of this area f 27] . 

While rapid and continuous improvements in the underly- 
ing technology of information systems have encouraged the 
use of information as a competitive weapon, only a few ad- 
vancements have been made in the development of manage- 
ment techniques in this area. In this paper, a specific decision 
support system (SDSS) is developed, using well-known man- 
agement science techniques, to provide IS managers with an 
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effective planning and decision-making tool. Here, we shall 
consider the SDSS to be the integration of hardware/software 
that allow a specific decision maker or group of them to deal 
with specific sets of related problems (see [35, pp. 10-11]). 
This SDSS provides them with an optimal mix of IS projects 
based on profit maximization criteria. Specifically, the system 
determines when to begin the project development, which sys- 
tems development language to use, and the number of systems 
development staff to assign to each project. A typical use of 
SDSS in an uncertain environment is described, with a sample 
output of the analysis. 

Modern corporations, faced with an increasingly volatile 
environment and fierce competition, often demand more from 
their IS development department than their existing staff re- 
sources can handle. The resulting backlog must be prioritized 
and scarce resources allocated to IS 1 projects in such a way 
that the choices maximize ''value" for the corporation. These 
decisions will ultimately determine the nature and timing of 
the firm's information system, which is frequently a key factor 
in their ability to respond quickly to opportunities or compet- 
itive threats in the market place. A portfolio of new projects 
must be selected from the development backlog and resources 
assigned in such a manner that maximizes value under the 
constraints imposed by a limited staff. At present, IS planning 
lags behind most other corporate-level planning systems, de- 
spite the strategic importance of these systems for corporate 
survival and potential growth. Existing studies have found that 
effective IS planning systems arc still relatively rare in con- 
temporary computer centers [15], [19], [21]. 

The need for an effective framework in which a firm's 
IS project portfolio can be selected in an uncertain environ- 
ment is readily apparent. Efficient use of IS resources can 
be achieved through the integration of systems, the minimiza- 
tion of system changes, and the effective prioritization and 
scheduling of competing IS projects. These projects should 
be evaluated in the same critical manner as any other major 
corporate investment such as plant equipment or the introduc- 
tion of a new product line. In fact, IS planning can borrow 
from techniques used for capital budgeting allocation deci- 
sions, where scarce or limited resources and the presence of 
uncertainty are also major issues. In this paper, we propose 
a specific decision support system (SDSS) which utilizes a 

'IS projects consist of software developments, hardware decisions, and 
their implementation. 
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typical resource allocation model framework as a modeling 
component of the system [11], [35]. 

Finding the optimal mix of development projects over some 
defined planning interval is a formidable task even when num- 
ber of critical variables and their relationships are known with 
certainty. Furthermore, the changing nature of IS systems in- 
troduces considerable uncertainty to many of the factors in- 
volved in the portfolio decision. These uncertainties can af- 
fect the estimation of project benefits, development time, and 
hardware requirements. There is an obvious need for a com- 
prehensive set of tools and techniques to improve decision 
making in the complex and uncertain process of IS portfo- 
lio management. The proposed SDSS will provide a method- 
ology that can be used to evaluate the risk associated with 
the estimates and their impact on profits explicitly. Informa- 
tion obtained, in turn, will assist the firm with its strategic 
and planning process. A detailed description of the proposed 
SDSS will be given in Section III. 

IS Project Planning Tools 

The most common forum for IS portfolio management de- 
cision making is the IS Steering Committee, according to the 
survey of 127 companies performed by Nolan [25], A distinct 
majority (85 percent) of those companies claimed to use this 
approach to select projects and allocate staff, although most 
of the committees (73 percent) met no more frequently than 
every three months for a few hours. We can therefore assume 
that the formulation of the proposed IS portfolio is relegated 
to lower-level committees and the IS executive support staff. 
In these lower-level forums, decision making by consensus is 
typical, with only limited recourse to analytical tools [25]. 
There is very little explicit evaluation, therefore, of the trade- 
offs between the risk and return of various projects. 

A number of models have been suggested to improve this 
process. Among them is one suggested by Buss [3], in which 
the IS executive must form a composite ranking of poten- 
tial projects based on financial costs and benefits, intangible 
benefits, technical importance, and conformity to the organi- 
zation's objectives. Presumably by allowing intangible, tech- 
nical, and strategic issues to enter into this ranking process, 
the uncertainty associated with profitability estimates can be 
avoided. Unfortunately, accountability for financial results and 
the ability to compare the financial benefits of different IS 
projects are lost in the process. 

McFarlan [21] takes an important step by including risk as- 
sessment in his model. He argues that the size and structure 
of a project and the firm's experience with the technology in- 
volved are the chief determinants of risk. He does not directly 
determine the relationship between risk and return, however, 
and the methodology relies on a number of somewhat arbi- 
trary surrogates to link expected return with degree of risk. 
Kanter [15], [16] uses a rating system to prioritize projects. 
This also depends on an arbitrary, intuitive scale. Another ap- 
proach, presented by Long [19], uses a series of evaluators to 
form a consensus risk evaluation in a matrix format. Moore 
[22] and Putnam [28] both used similar techniques on dif- 
ferent, but related, topics. Research and development (R&D) 
portfolio selection models utilizing myriad ranking procedures 



or mathematical programming methods are described in [5], 
[7], [10], [20], [33]. A risk index scheme, such as the one 
proposed by McFarlan requires the IS manager to know the 
total risk index of an IS applications portfolio, and have the 
ability to penalize "high-risk" projects. The optimal compo- 
sition of IS projects is governed by the total risk index of the 
portfolio and the preassigned risk value. The proposed model 
does not assign the risk values to the individual projects but 
rather it considers the degree of uncertainty associated with 
the quantitative estimates of the environmental variables (for 
example, a large standard error). That is, for our purposes 
risk can be defined to be the variability of the parameters be- 
ing estimated. Of course, this is related to the McFarlan 's risk 
index measure since the difficulties in estimating the environ- 
mental variables leads to the project being classified as high 
risk [21]. While one can adopt risk-adjusted project portfolio 
selection procedures [6], we believe it would be perferable 
to develop a method which would allow the IS manager to 
view the uncertainty of estimates explicitly in terms of its im- 
pact on profits. The risk-return construct is portrayed by the 
probability distribution of NPV. 

In this paper, an SDSS system based on both integer lin- 
ear programming and Monte Carlo simulation techniques is 
described. It incorporates the following features, which we 
believe to be essential for an IS portfolio management model 
in today's competitive environment. 

1) Multiperiodicity: Staff allotment, the time-value of 
money and the improvement of price performance of com- 
puter hardware can all be included as a function of time. 

2) Effect of Uncertainty: Sensitivity analysis is performed 
to examine the possible effects on expected return, cost, and 
project size. 

3) Development Technology: Tradeoffs concerning devel- 
opment staff productivity and hardware costs are considered. 

4) Diminishing Marginal Productivity: The reduction in 
productivity of each additional person assigned to a project is 
also taken into account in this model. 

5) Value of Additional Information: The information 
phase of the SDSS contains a technique for assessing the value 
of a further study to reduce uncertainty. 

The SDSS Model 

The DSS/SDSS described in this paper, defined here as a 
computer system designed to aid management decision mak- 
ing, Sprague and Carlson [29] and Vazsonyi [32], is concep- 
tually divided into three distinct phases: deterministic, prob- 
abilistic, and informational. The second two phases use the 
output of the preceding phase as input. The initial, or deter- 
ministic phase, is generated using data determined by the IS 
manager according to his own environmental estimates and as- 
sessment of project characteristics. The SDSS software pack- 
age is written in Statistical Analysis System (SAS), a general- 
purpose data analysis language with extensions for a mathe- 
matical programming, graphic, and report- writing facilities. 
The SDSS software runs on IBM 370/30XX/43XX and other 
mainframes. It is possible to adopt this code for the micro en- 
vironment with 80386 processor and we hope to accomplish 
this in near future. Each phase will now be examined. 
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Deterministic Phase 

The various inputs required for the integer linear program 
used during this phase can be categorized as follows: a perfor- 
mance measure (for the objective function), exogenous param- 
eters, policies and constraints, decision variables, and inter- 
mediate variables. These inputs are generated by using data 
determined by the IS manager according to his own envi- 
ronmental estimates and assessment of project characteristics. 
Although, the estimations of project characteristics such as 
size, complexity, effort, and benefit are a difficult task for 
IS managers there are some well-known estimation models 
he/she can utilized. For example, the COCOMO model esti- 
mates the man-month development effort as well as the soft- 
ware development time [2], SLIM [28] and ESTIMACS [2] 
are software packages that can provide cost estimates of the 
projects. However, Boehm states that the estimation of these 
project parameters is a very difficult task and concludes that 
the estimates obtained are often very different from the ac- 
tual realizations. Empirical findings of the reliability of the 
cost estimation models are reported by Kemerer [17] where 
he concludes that all of the models tested failed to sufficiently 
reflect the underlying factors affecting productivity. In view 
of these estimation difficulties, the major contribution of the 
proposed model, we believe, is its ability to assess explicitly 
the value of additional information in estimating number of 
key variables affecting both the profit level and the probabil- 
ity distribution of profits. 

The chosen performance measure consists of the total net 
benefit of all projects completed within the planning horizon, 
expressed in present value terms. This value is the sum of 
the differences between the value of actual benefits and the 
actual dollar investment in hardware for all projects selected. 
Although number of measurements can be used as a perfor- 
mance measure of the project, the net present value (NPV) 
criterion is the only one that is necessarily consistent with the 
maximization of shareholder's wealth [6]. For this model, we 
shall assume usual economic theory where the firm is assumed 
to maximize shareholder's wealth. 

Exogenous parameters, estimated by the IS manager, in- 
clude the following: 

1) Net project benefits, excluding hardware and systems 
development costs but including all other costs, are expressed 
in terms of equivalent monthly savings in current dollars which 
would result from an immediate implementation of the project. 
We note that these benefits will begin to flow only when the 
system's development is complete, and so it is assumed that 
these benefits will be reduced by the time-value of money as- 
sociated with the delays in 1) beginning and 2) conducting the 
systems development. Therefore, these values are discounted 
by firm's weighted average cost of capital (WACC) [6]. 

2) The Price-performance improvement factor (PPI), re- 
flecting the declining cost per unit of computing power and 
the lower price of computer hardware with time, must be pre- 
dicted for the planning horizon in question. 

3) Program language efficiency is expressed in terms of a 
''language efficiency multiplier'' for each type of language, 
given that high-level languages require considerably more 



computing hardware than lower level languages. For example, 
if conventional languages such as COBOL are given a multi- 
plier of 1, and fourth generation languages such as FOCUS 
are given a multiplier of 10. The estimates of these values are 
partially based on work due to Jones [14] and one of the au- 
thor's experience in the MIS department at Canadian National 
Rail. Of course, these estimates can be adjusted for the par- 
ticular organization and its environments. Here, we are also 
assuming that the development activities are affected by the 
choice of programming language. 

4) The cost of additional computer hardware required for 
each project must be expressed in current dollars (as if pur- 
chased immediately), assuming that a conventional program- 
ming language has been used (normalized, see Jones [14]). 

5) Development effort "size" is frequently measured in 
"function points" [14], [18], which are based on a number 
of factors related to size and complexity, i.e., number of user 
inputs, user outputs, inquiries, logical master files, and log- 
ical interfaces to other systems. Function points are derived 
using an empirical relationship based on countable measures 
of the software's information domain (such as the number of 
user inputs and outputs) and subjective assessments of soft- 
ware complexity. Albrecht and Gaffiney [1], based on their 
empirical study, used the following weights for the complex- 
ity measure in calculating the function point: for the input 
(4), for the output (5), for the number of inquiries (4), for the 
number of master files (10) and, for the number of interfaces 
(7). The final sum of the products of the functions and their 
weights is called a function point. This methodology can be 
used to estimate the number of lines of source code for any 
programming language (see Jones [14, p. 77]). 

6) Labor productivity estimates are based on two known 
factors related to project labor efficiency: the greater pro- 
gramming efficiency of higher level languages versus lower 
level languages and the diminishing marginal productivity rate 
associated with each additional worker added to a project for 
each language type. 

Policies and constraints, provided by the IS manager, are 
used as input parameters during this phase. Three such inputs 
are included in this model: 

1) A fixed programming staff during the planning horizon 
is assumed. This model provides a short-run view in the sense 
that, during the planning period, the size of the programming 
staff cannot be increased due to the chronic shortage of qual- 
ified people in the labor market, and will not be reduced due 
to the long-run importance of retaining such people for future 
undertakings. The cost of retaining this staff is therefore a 
sunk cost in this analysis, 

2) Prior to input, net present values must be established. 
Specifically, the firm's weighted average cost of capital 
(WACC) is used in this study as a discount rate. 

3) A fixed planning horizon, which may consist of several 
planning periods, must be established by the IS manager. 

Intermediate variables must be determined for each 
project. For the purpose of this exercise, three key variables 
are included: 

1) The duration of development effort for each project, a 
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function of language selected and staff assigned to the project, 
must be established. 

2) Actual benefits for each project must be determined as 
a function of stated project benefits, starting time of the de- 
velopment, the duration of the development effort, and the 
discount rate employed. 

3) Hardware costs required to support the implementation 
of each project are based on current hardware costs, the 
price-performance factor, a language efficiency multiplier, 
start and finish time for the development effort, and the dis- 
count rate. 

Finally, the decision variables produced by the integer lin- 
ear program will provide the IS manager with the following 
four optimal decisions, based on the inputs outlined above: 

1) Which projects to develop. 

2) When to begin the development of each chosen project, 

3) The number of people to assign to each project. 

4) The appropriate programming language for a given 
project. 

A net benefit is computed for each combination of decision 
variables, and an integer linear program is constructed with 
these net benefits as objective function coefficients to maxi- 
mize total net benefits subject to fixed staff constraints within 
a given horizon. 

The relationships discussed previously provide the founda- 
tion for an integer linear programming model which enables 
the IS manager to make an optimal choice of projects, start- 
ing times, programming languages, and staff levels. Each of 
the projects being considered can be thought of as a number 
of mutually exclusive subprojects, one for each combination 
of programming language, staff assignment size, and starting 
time. A net benefit can be computed for each such combina- 
tion and an integer linear program (ILP) then constructed with 
these net benefits as objective function coefficients. This ILP 
is formulated to maximize total net benefits subject to fixed 
staff constraints within a given horizon. A detailed description 
of the modelling component of the SDSS is as follows: 

Let 



Zphq 



P 

L 



Q 

T 



* plsq 



be the number of projects under consideration, 
be the number of possible types of programming lan- 
guage, 

be the number of possible staff allotments. That is, 
there are S such allotments, each with a value of, say 
N 5 ,s = l,2,3,--,S, 

be the number of periods in the planning cycle, 
be the total number of staff available; 



1 if project p begins development using 
language type / and staff allotment s 
in period q, for 1 < p < PJ G {1, 2, * • • ,L}, 
1 <s <S, and 1 <q < Q 

0 otherwise; 



1 if the development of project p using 
language type 1 with staff allotment s 
is active during period q, for all pj,s,q 

0 otherwise; 



NPV^/ J£7 be the net benefit from subproject plsq, as com- 
puted in the model described earlier (this essen- 
tially is the value added to the firm by adopting 
the project at period p with the appropriate re- 
source composition), 

DUR^/s be the number of periods required to develop 
project p using language / with staff allotment 
5, i.e., it is the project duration of the project 
commencing at period p. 

We wish to maximize: 

plsq 

plsq 

subject to: 

1) staffing constraints in each period: 

pis 



N * z ptsQ ^ T 

pis 

2) mutual exclusivity constraints: 

^ X Usq < 1 

fsq 



Isq 

3) period-linking constraints: 

- x p ts\ z p is\ < 0 

— X p is2 — Z p !s\ — Z p is2 < 0 



- XpisQ - Z p i,(q-\) + ZpisQ < 0, for all pj t s 

4) integer constraints: 

Xpisq, Zphq = 0, 1, for all p, /, s, q. 

For larger values of P, L, S, and Q, the problem becomes 
quite large. It contains 2*P*L*S*Q integer variables and P + 
Q HQ + \)*P*L*S constraints. If, for example, there are 10 
projects under consideration (P = 10), three possible levels of 
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programming language (L = 3), 100 possible staff allotments 
(S — 100) corresponding to a total staff of T — 100, and 60 
months in the planning interval (Q = 60), the problem will 
involve 360 000 variables and 183 070 constraints. 

Suggested simplifications which will not significantly re- 
duce the usefulness of the results include: 

1) Reducing the number of time periods by introducing 
quarter periods (i.e., 3 months at a time) as well as limiting 
the total period considered (i.e., from 5 to 3 years) alters the 
number of periods considered from 60 to 12. 

2) Reducing the number of possible staff sizes to be allo- 
cated to each project in a manner which favors small sizes 
to reduce the effect of diminishing marginal productivity of 
large groups will result in fewer group sizes used. For exam- 
ple, instead of considering every combination possible, only 
8 staff sizes could be considered. 

3) Depending on the firm, it is possible that only 2 levels 
of language may be realistically included, rather than 3. 

The resulting example would now have only 3840 variables 
and 2102 constraints. Further reductions could be achieved 
through the exclusion of subprojects which are found to have 
hardware costs which exceed their benefits or cannot be com- 
pleted within the planning horizon established. 

In summary, the deterministic phase of the SDSS generates 
an integer linear program customized by the specific values 
of the exogenous and policy parameters of the model user. 
An IP solution is then generated to obtain that combination of 
projects, start times, and language levels which optimizes the 
net present value of the project mix. This optimal IS project 
composition should provide the firm with "maximum" or 
"best" use of their information systems resources since it is 
determined within the scope of firm's strategic planning (e.g., 
the calculation of benefits, the policy constraints). 

The next phase of the SDSS addresses the important issue 
of uncertainty. Zmud [42] states that "An important insight 
to understanding the problems associated with managing soft- 
ware development is that most difficulties can be traced to the 
uncertainty that pervades software development." 

Probabilistic Phase 

While risk analysis has been used profitably to identify 
high-risk projects upon which to focus management attention 
during development, its role in IS project selection normally 
involves the assignment of a risk index of some type and the 
manager is expected to combine IS projects so that the total 
"portfolio" risk index is within the given range. 

While such schemes could easily be incorporated into the 
deterministic phase of this model, it would be preferable to 
develop a method which would allow the IS manager to view 
an estimation risk explicitly in terms of its impact on profits. 

We will now introduce uncertainty to the modeling compo- 
nent of the SDSS, and observe how the profitability of the op- 
timal decision found by the integer linear program in the deter- 
ministic phase is affected. In this manner, the risk associated 
with the quantitative estimates of the exogenous parameters 
can be considered explicitly in terms of its impact on profits. 
This is accomplished by allowing some of the exogenous pa- 
rameters, which so far have been considered fixed, to become 



random variables. Values for these will be generated using a 
Monte Carlo simulation. Although it is much more realistic to 
represent these exogenous parameters by dependent random 
variables, the computational burden, especially for the infor- 
mational phase of the model makes it somewhat untractable. 
In any event, we believe that the procedure suggested here 
reflects the actual situation sufficiently well and remains com- 
putationally tractable for realistic problems. The pioneering 
work of utilizing the Monte Carlo method in project selection 
problems is largely due to Hertz [13]. Spetzler [34] provides 
a similar method of dealing with risk where a corporate capi- 
tal investment decision must be made. Three parameters have 
been chosen to become stochastic in our example on the basis 
that they are most frequently the source of serious estimation 
errors in IS planning; project benefits, hardware costs and 
project size. We assume that their probability distributions, 
which may be developed from historical data or subjective 
assessment, are known. Realizations are then generated ac- 
cording to their respective distributions. A new optimal solu- 
tion and its benefits are computed for each of the realizations 
generated for these parameters, which we had assumed to be 
fixed in the deterministic phase. When this process is repeated 
many times, a cumulative probability distribution function of 
the total net benefits under these conditions of uncertainty can 
be developed. 

Certain feasible situations must be dealt with when trying 
out each of these new possibilities. In the case where a staff 
shortfall is introduced through the changing variables, the sim- 
ulation assumes that temporary programmers will be obtained 
from an outside source at double the gross salary for the pe- 
riod in question. It is also assumed that a temporary group 
will be employed to complete any work beyond the planning 
horizon, under the same salary conditions. We note that this 
situation does not occur in the deterministic phase since the 
exogenous parameters are constant. 

The SDSS allows the random variables to be considered in- 
dividually as well as in combination. The final output for each 
selection of variables to be analyzed is a cumulative probabil- 
ity distribution of total net benefits which can be used to assess 
the sensitivity of this value to random changes in the selected 
parameter(s). 

Informational Phase 

Having made a posterior analysis to determine the degree of 
variability of profitability of the optimal solution under uncer- 
tainty, the IS manager may wish to reduce this uncertainty in 
specific parameters if the variability is at unacceptable levels. 
Various measures, such as work studies to establish project 
benefits more firmly, or a more detailed system design to 
establish project size and hardware requirements, can be per- 
formed for certain projects at this stage. However, the delays 
associated with further studies and the costs incurred by these 
studies may exceed potential benefits. An estimate of the value 
of this extra information would be beneficial before commis- 
sioning extra design work or studies. The procedure by which 
this value is obtained is generally referred to as preposterior 
analysis. 

In order to establish this value, this is, the value of per- 
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TABLE 1 



PROJECT EXPECTED 
NUMBER BENEFITS 

(/month) 


STANDARD 
DEVIATION 


EXPECTED 

INVESTMENT 

(Hardware) 


FUNCTION 
POINTS 


1 $ 25,000 


$ 5,000 


$ 500,000 


3,800 


2 $ 35.000 


$ 5.000 


$ 500,000 


7,000 


3 $ 40,000 


S 4,000 


$ 60,000 


7,600 


4 $ 75,000 


S 30,000 


$ 900,000 


7.500 


5 $ 100,000 


$ 50.000 


$ 200,000 


9.500 



feet information, the integer linear programming of the first 
phase and the Monte Carlo simulation techniques of the sec- 
ond phase must be combined. The original optimal solution 
of the deterministic phase is evaluated under each of the ran- 
dom "realizations" generated during the probabilistic phase, 
using the same assumptions concerning infeasibility as were 
used earlier (temporary staffing). These benefits will then be 
compared with those of the new solutions generated under the 
same realizations during the probabilistic phase. The new op- 
timal solution, by definition, will yield higher benefits than 
the deterministic solution which was generated under differ- 
ent conditions. The difference represents the increase in total 
benefits that would have been obtained if the realizations gen- 
erated on a random basis had been forecast, and the new 
optimal solution had been implemented instead of the orig- 
inal solution generated during the deterministic phase. This 
process is repeated until a cumulative frequency distribution 
emerges for all of these differences. This cumulative distribu- 
tion function represents the value of perfect information for 
the chosen variables. It provides the relative frequency that a 
minimum amount of money can be saved if the IS manager can 
foresee the future and make an optimal decision accordingly. 

SDSS Results 

It is not within the scope of this paper to detail all the re- 
sults that can be obtained by the SDSS model. We will use 
an example which illustrates those analyses deemed of gen- 
eral interest and the type of results which are considered most 
useful. In this example, we assume that the IS manager of a 
medium-sized installation has a total programming staff of 50 
people. Five possible projects were identified, in conjunction 
with the user departments of the CN Rail by one of the au- 
thors. Initial feasibility studies and external designs have been 
conducted, resulting in the following information in Table I. 

The "standard deviation" figures in Table I refer to the 
project benefits. It has been determined through discussions 
with users that the project benefits are normally distributed. 
The mean and standard deviation estimates are use to gener- 
ate the appropriate distributions. The distributions of project 
size and hardware investment, on the other hand, have been 
found to be Erlang variates. While these distributions are con- 
sistent with our experience, the SDSS provides the ability to 
generate random variates from a large number of other dis- 
tributions. The IS manager thus can select from among these 
(e.g., Beta distribution) and incorporate them into the model. 
The shapes of the benefits and project size distributions of 
project 1 are illustrated in Fig. 1. In this example, we have 
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Fig. 1. Probability distributions of (a) project 1 benefits distribution and 
(b) project 1 size distribution. 
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Fig. 2. Labor productivity curves by language type, staff size. 

set T = 50, Q = 12, P = 5, L = 2, 5 = 8, WACC = 0.16, 
and PPI = 0.1. The hardware efficiency factors for lower 
level and upper level arc 1 and 10, respectively, and the la- 
bor productivity rates are as indicated in Fig. 2. An example 
calculation of net present value using one possible set of de- 
cision variables is in Appendix I. The deterministic phase of 
this problem required 5542 iterations, and consumed 1 14 min- 
utes of computer time on an IBM-compatible processor with 
an execution speed of approximately 6. 5 -million instructions 
per second. SDSS initially creates an input file with project 
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Fig. 3. Sensitivity analysis: parameter changes. 

information, and constructs and then executes the integer pro- 
gram to select an optimal solution. The optimal solution is 
as follows: begin project 3 immediately, use an upper level 
language, and assign 19 people. The project will require 9 
months to complete. Begin project 5 immediately, also us- 
ing an upper level language, and assign 31 people. It will be 
completed in 9 months. When projects 3 and 5 are complete, 
assign all 50 people to project 4 using a lower level devel- 
opment language. This project will then require two years to 
complete. Following this plan will result in net benefits with 
a present value of $11 300 300. 

The probabilistic phase of SDSS was performed allowing 
the following parameters to vary: benefits, hardware invest- 
ment and size estimates. Each one was allowed to vary on 
an individual basis and then all three exogenous variables 
were made to vary simultaneously. In each case, 500 itera- 
tions of the Monte Carlo simulation process were performed. 
The resulting cumulative distribution functions are reproduced 
in Fig. 3. We note that the project size estimate appears to be 
the most critical parameter among the 3 parameters we chose, 
since it has the highest variation. We also note the relative 
insensitivity of benefit and hardware parameters. 

The final (informational) phase of the SDSS can provide 
some assistance in determining the amount of effort the IS 
manager should spend in obtaining better estimates of these 
parameters. The SDSS was run allowing benefits, hardware 
investment, and project size to vary simultaneously. 

In total, 100 iterations of the Monte Carlo simulation in 
the informational phase were performed, each involving the 
construction and solution of a large integer linear program. 
Computer time of 1398 minutes on a 6.5-million- instructions- 
per-second processor were required to conduct this analysis. 
Here, the IS manager needs to determine the "value" of ad- 
ditional information obtained since the informational phase of 
the SDSS requires considerable amount of computer time. It 
is recommended that this part of the model should employed 
for the cases where good estimates of the exogenous variables 
are not available to the IS manager. 

The cumulative frequency distribution of differences be- 
tween the net present value of the optimal solution for each 
random state of nature and those of the original deterministic 
phase solution evaluated under the conditions represented by 
the random state of nature is presented in Fig. 4. 
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On the basis of this information, the IS manager would be 
justified in spending up to $2 million on activities that provide 
better estimates of the three parameters allowed to vary in this 
example. This follows from the cumulative graph of Fig. 4, 
since there is a very good chance (greater than 90 percent) that 
EVPI exceeds $2 million. Here, of course we should note that 
an additional information does not always add "value" to the 
decision making process. This follows since no amount of ad- 
ditional information can alter the "optimal" decision. In such 
a case, the information is valueless and any cost incurred in 
gathering additional information is a sunk cost. The numerical 
value of additional information, the expected value of sample 
information (EVSI), is the difference between the expected 
value of the optimal decision using the sample information 
and the expected value of the optimal decision without any 
additional information (EV). This value range from zero to 
an upper bound of the expected value of perfect information 
(EVPI), depending upon the reliability of the estimates. 

The principles of decision analysis can be applied to de- 
velop an effective SDSS for the IS project planning process. 
Unlike previous models, the SDSS model in this paper ex- 
plicitly incorporates uncertainty and examines the impact of 
uncertainty of important factors in IS planning on the firm's 
profitability. 

Throughout our discussions, we have assumed that IS man- 
agers can provide appropriate subjective or objective assess- 
ments of exogenous parameters such as benefits, project size, 
and hardware costs according to his own environmental esti- 
mates and assessment of project characteristics. Although an 
estimation of project complexity, effort, and benefit are a dif- 
ficult task for IS managers there are some estimation models 
he/she can utilize. For example, estimation models such as 
COCOMO, SLIM, and ESTIMACS can assist managers in 
developing quantitative estimates. If this is not feasible, then 
the subjective estimation procedures such as expert resolu- 
tion (see Morris [23], [24]) can be utilized in estimating the 
parameters. 

In this study, the risk is measured by the degree of 
uncertainty associated with the exogenous parameters such 
as project benefits, Price-performance improvement (PPI), 
"language efficiency multiplier" for each type of language, 
size, and complexity, and labor productivity level. An IS man- 
ager can utilize this information to establish the precise rela- 
tionship between risk and expected return related to particular 
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uncertain variables which are encountered when implementing 
IS projects. By providing a tool by which the IS planner can 
evaluate the value of additional information, studies to reduce 
uncertainty of the estimates can be assessed in terms of their 
cost justification. After a final iteration of the process con- 
tained in this SDSS, an IS manager can provide the steering 
committee executives with firm recommendations for staff al- 
locations, scheduling, and appropriate development languages 
for each project scheduled. He or she can also justify their 
choices based on a satisfactory risk-return relationship and 
the probable impact on profitability of alternative solutions. 

In our example, three parameters have been chosen to be- 
come stochastic on the basis that they are most frequently 
the source of serious estimation errors in IS planning; project 
benefits, hardware costs, and project size. We have assumed 
that their probability distributions, which may be developed 
from historical data or subjective assessment, are known to 
the IS managers. 

There are number of future improvements that can be made 
on SDSS to enhance the usefulness of this model. To begin 
with, one can develop an interactive estimation models of ex- 
ogenous parameters such as language efficiency multiplier, 
function points, and labor productivity factor. These mod- 
els can then be interfaced with the SDSS to better reflect the 
manager's ability to estimate these environmental factors. This 
could take the form, for example, of an interactive computer 
session between the " experts" and the SDSS which constructs 
the appropriate probability distributions for critical variables 
based on the answers to a series of pertinent questions. Sec- 
ond, the number of variables which are allowed to take on 
random values could also be increased. Examples are labor 
productivity, planning horizon, future cost of hardware, and 
language efficiency. Of course, the care must be exercised in 
expanding the number of factors considered as a stochastic 
factor since this will increase the computational burden con- 
siderably. Finally, the computational aspect of the model can 
be improved upon by utilizing more efficient language with 
the additional programming efforts. Also, one can develop a 
micro version of the model, perhaps by using the program- 
ming language such as C. 

As a final note, the cost of developing a complete DSS as 
discussed above is in the order of 2 to 3 person years. Al- 
though initially this investment may seem somewhat large, if 
it is compared to the cost of supporting less than optimal sets 
of projects, then these developmental costs shrink in compar- 
ison. 

Appendix I 

A typical scenario that illustrates the use of various param- 
eters is described in this appendix. 

Suppose project A provides $30 000 monthly benefits when 
implemented and the development effort has been estimated to 
be 6 000 function points. Moreover, if purchased today, the 
hardware to support the implementation of project A would 
cost $100 000 if the project used an intermediate level lan- 
guage such as COBOL. It is further known that the hard- 
ware efficiency factors are estimated as: low level language 



(e.g., Assembler) — 0.5; intermediate level language (e.g., 
COBOL) = 1.0; high level language (e.g., Focus) = 10.0. 

Also the IS manager estimates the price performance of 
hardware to fall by 10 percent annually during the next three 
years. That is, PPI = 0.1. The company's weighted average 
cost of capital (WACC) is 16 percent, and the Fig. 2 of the 
text expresses the productivity of labor. 

Finally, supposed that the IS manager has decided to de- 
velop project A beginning one year from now. The project 
will be developed using FOCUS, and 10 programmers will 
be assigned to its development (a particular set of decision 
variables). 

The problem is to determine the net benefit of this decision. 
The intermediate variables are computed as follows: 

Project Duration: Ten programmers can produce 500 func- 
tion points per period (month) if programming is done in a 
high level language (see Fig. 2). Therefore, the project will 
require one year to develop. 

Actual Benefits: Development will begin in one year and 
will require one year to complete. The stated benefit of 
$30000 per month is a perpetuity with a value of $30000 
divided by the monthly cost of capital, but must be discounted 
to account for the two-year delay. The present value of project 
A is therefore 

($30 000/((1.16)- 1/12 - 1))*((1.16)- 2 ) = $1 791 454. 

The stated hardware investment of $100000 must be mul- 
tiplied by a hardware efficiency factor of 10 to account for 
the high level programming language selected. It must then 
be multiplied by (0.9)*(0.9) to account for the fact that the 
purchase will only occur in two years, and that the price per 
unit of hardware is falling by 10 percent annually. Finally, it 
must be adjusted by the time-value of money. The appropriate 
calculation is as follows: 

$100000~(0.9) 2 *10~((1.16) 2 ) = $601 962. 

The net benefit from project A under these conditions is 
equal to 

$1 791 454 - $601 962 = $1 189492. 

This example illustrates how the value of a single project is 
determined, given a choice of development language, a start- 
ing time, and a staffing level. Similar computations would be 
performed for each project to be undertaken, and the total net 
benefit of this specific set of decision variables would simply 
be the sum of the individually computed net benefits. 
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